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TITLE OF THE INVENTION 
METHOD AND SYSTEM FOR BLIND KARHUNEN-LOEVE TRANSFORM CODING 

CROSS-R EFERENCE TO CO-PENDTNG APPLICATIONS 
The present application is related to and claims priority to U.S. Provisional 
Application Serial No. 60/239,930, filed October 13, 2000. The contents of that application 
are incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to the field of signal coding, and more specifically to 
Karhxmen-Loeve transform coding. 

Discussion of the Background 

Transform coding is a known technology for coding signals. Figure 1 shows a block 
diagram of a conventional transform coder, including a transmitter 10 and a receiver 1 1. At 
the transmitter 10, an original discrete-time signal frame x n is transformed by a transformer 
100 into transform coefficients v„. Each signal frames, for n = 1, 2, 3, ... is generally 
comprised of a continuous segment of length TV of a discrete-time signal x(k) and can be 
defined, for example, as x n = [x(nN-l) x(nN-2) ... x(N(n-l))] T . Further, the segments of the 
signal x(k) defining the signal frames x n can overlap up to N-l elements or be totally non- 
overlapping. 

The transformation preferably decorrelates the original signal frame and compacts a 
large fraction of the signal energy, i.e. variance, into relatively fewer transform coefficients. 
This is known as an energy-packing property. Because of this property, it is possible to 
retain a fraction of the transform coefficients without seriously affecting the reconstructed 
signal quality. The transform coefficients are quantized at the quantizer 1 10 to yield the 
quantized transform coefficients y n . As a result of quantization and the possible elimination 
of redundant transform coefficients, the quantized signal y n that is encoded by the encoder 



120 may contain significantly less than the N elements in the original signal frame x n . The 
encoded signal is then sent along the channel. 

At the receiver 1 1 , the encoded signal is received through the channel into the 
decoder 130. The signal is decoded, yielding the quantized transform coefficients y n . The 
5 original signal frame is reconstructed at the inverse transformer 140 to produce the 

reconstructed signal frame x B . Because the transform coefficients were quantized and some 
redundant or insignificant transform coefficients were possibly eliminated prior to encoding, 
the reconstructed signal frame x n is generally slightly different from the original signal 
frame x n . 

10 The Karhunen-Loeve transform (KLT) is known to be the optimum transform for 

signal compression because the KLT exhibits a significant energy-packing property. In other 
words, a larger fraction of the total energy or variance of the signal frame is contained in the 

Pi 

first few coefficients, as compared to other transforms. Therefore, the number of transform 
coefficients retained, quantized, and encoded can be significantly less than other transforms. 
1ST As a result, the signal bit rate during transmission is reduced while the signal quality is 
jfi«j maintained. More details concerning the KLT are found in Digital Coding of Waveforms , by 
^ N. Jayant and P. Noll, 1984, the entire contents thereof incorporated herein by reference. 
&&, Additional information about KLT may also be found in (1) C.E. Davila, "Blind Adaptive 
j[f Estimation of KLT Basis Vectors", Transactions on Signal Processing . Vol. 49, No. 7, pgs. 
201 1364-1369, July, 2001; (2) C.E. Davila, "Blind KLT Coding," Proc. 2000 IEEE Signal 
M ; Processing Workshop . Hunt, Texas, October 15-18, 2000 (the proceedings of which are 
available via HTTP at 

"spib.rice.edu/SPTM/DSP2000/submission/DSP/papers/paperl 53/paperl 53 .pdf '); and (3) 
C.E. Davila, "Blind Adaptive Estimation of KLT Basis Vectors," Proc. IEEE International 
25 Conference on Acoustics, Speech, and Signal Processing, Istanbul, June 5-9, 2000. The 
contents of those papers are incorporated herein by reference. 

In the transformer 100, the KLT transform coefficients y n are determined by applying 
a KLT transform matrix Q to the original signal x n , as shown in Equation (1), 

y a = Qxn- (i) 

30 The net effect of the transformation is to establish a new coordinate system whose origin is at 
the centroid of the population of the original signal frame x n and whose axes are in the 
direction of the eigenvectors of the autocorrelation matrix R of the original signal frame x n . 
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The eigenvalues are the variances, i.e., original signal energy, of the KLT transform 
coefficients y n along the eigenvectors. The eigenvectors form the column vectors of the 
transform matrix g, and are also referred to as KLT basis vectors. 

Unfortunately, the KLT basis vectors are data-dependent, i.e., they require an 
5 estimate of the autocorrelation matrix of the original signal frame x n for their computation. 
Hence, in order to reconstruct the original signal frame at the receiver 1 1, the KLT basis 
vectors must also be encoded with the KLT transform coefficients and transmitted to the 
receiver. The necessity of transmitting the KLT basis vectors reduces signal compression and 
leads to increased bit rates. For this reason, the KLT has had limited use in signal coding 
10 algorithms. 

n SUMMARY OF THE INVENTION 

m Accordingly, one object of the present invention is to provide a method and system to 

%| use the Karhunen-Loeve transform to encode, transmit, and accurately reconstruct a signal 

CH 

frame without suffering a reduction in signal compression or increased bit rates. 
tt f\S A further object of the present invention is provide a method and system to encode 

fg and transmit KLT coefficients, without having to encode and transmit KLT basis vectors. 

pi; 

Another object of the present invention is to estimate basis vectors from the KLT 
transform coefficients at the receiver. 
Q Another object of the present invention is to provide a method and system to 

ipsa'; 

20 reconstruct the original signal frame using the estimated KLT basis vectors at the receiver. 

These and other objects are accomplished by way of a KLT coding method, system, 
and computer program product constructed according to the present invention, wherein the 
KLT transform coefficients of an original signal frame are calculated at a transmitter, the 
KLT coefficients are transmitted to a receiver, KLT basis vectors of the original signal are 

25 estimated at the transmitter and the receiver based on the KLT transform coefficients, and the 
original signal frame is reconstructed at the receiver from the estimated KLT basis vectors, 
thereby performing "blind" KLT coding. This is called "blind" KLT coding because the 
receiver estimates the KLT basis vectors without explicit knowledge of the original signal 
frame x n . 

30 Thus, according to the "blind" KLT coding of the present invention, the KLT 

transform coefficients are encoded and transmitted, without the corresponding KLT basis 
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vectors, to a receiver, at which the signal frame is successfully reconstructed. 

BRIEF DESCRIPTION OF THE DRAWINGS 
A more complete appreciation of the invention and many of the attendant advantages 
thereof will be readily obtained as the same becomes better understood by reference to the 
following detailed description when considered in connection with the accompanying 
drawings, wherein: 

Figure 1 is a block diagram of a conventional transform coder which transforms, 
quantizes, and encodes an original signal at a transmitter and which receives, decodes, 
inversely transforms the transmitted signal at a receiver; 

Figure 2 A is a flowchart of the steps performed at the transmitter in a first 
embodiment of the invention in which the KLT basis vectors are estimated from the 
transform coefficients; 

Figure 2B is a flowchart of the steps performed at the receiver in the first embodiment 
of the invention in which the KLT basis vectors are estimated from the transform 
coefficients; 

Figure 2C is an exemplary algorithm of the first embodiment of the invention in 
which the KLT basis vectors are estimated from the transform coefficients; 

Figure 3 is a graph showing an exemplary result of the first embodiment of Figures 

2A-2C; 

Figure 4A is a flowchart of the steps performed at the transmitter in a second 
embodiment of the invention in which the KLT basis vectors are estimated based on the 
transform coefficients and a codebook index; 

Figure 4B is a flowchart of the steps performed at the receiver in the second 
embodiment of the invention in which the KLT basis vectors are estimated based on the 
transform coefficients and a codebook index; 

Figure 4C is an exemplary algorithm of the second embodiment of the invention in 
which the KLT basis vectors are estimated based on the transform coefficients and a 
codebook index; 

Figure 5 is a graph showing an exemplary result of the second embodiment of Figures 

4A-4C; 

Figure 6 A is a flowchart of the steps performed at the transmitter in a third 



embodiment of the invention in which the KLT basis vectors are estimated based on the 
transform coefficients and the number of KLT transform coefficients; 

Figure 6B is a flowchart of the steps performed at the receiver in the third 
embodiment of the invention in which the KLT basis vectors are estimated based on the 
5 transform coefficients and the number of KLT transform coefficients; 

Figure 6C is an exemplary algorithm of the third embodiment of the invention in 
which the KLT basis vectors are estimated based on the transform coefficients and the 
number of KLT transform coefficients; 

Figure 7 is a graph illustrating an exemplary comparison between the original signal 
10 and the reconstructed signal produced by the embodiment of Figures 6A-6C; 

Figure 8A is a flowchart of the steps performed at the transmitter in a fourth 
embodiment of the invention in which the KLT basis vectors are estimated based on the 
f -I transform coefficients, the number of KLT coefficients, and the number of bits per 

%1 coefficient; 

€i 

'%$ Figure 8B is a flowchart of the steps performed at the receiver in the fourth 

Pi 

C3 embodiment of the invention in which the KLT basis vectors are estimated based on the 
J 1 ] transform coefficients, the number of KLT coefficients, and the number of bits per 
« coefficient; 

q Figure 8C is an exemplary algorithm of the fourth embodiment of the invention in 

W which the KLT basis vectors are estimated based on the transform coefficients, the number of 
Q KLT coefficients, and the number of bits per coefficient; 

Figure 9 is a graph illustrating an exemplary result of the fourth embodiment of 
Figures 8A-8C; 

Figure 1 OA is a flowchart of the steps performed at the transmitter in a fifth 
25 embodiment of the invention; 

Figure 1 OB is a flowchart of the steps performed at the receiver in the fifth 
embodiment of the invention; 

Figure 10C is an exemplary algorithm of the fifth embodiment of the invention; and 

Figure 1 1 is a block diagram of a transform coder using KLT coding of the present 
30 invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Referring now to the drawings, wherein like reference numerals designate identical or 
corresponding parts throughout the several views. 

Estimation of the KLT basis vectors can be accomplished by estimating the 
5 autocorrelation matrix R n of an original signal frame x n , updating that estimate R n each 
time a new signal frame is obtained, and estimating the eigenvectors and eigenvalues of the 
autocorrelation matrix R B . Recall that the eigenvectors of the autocorrelation matrix are the 
KLT basis vectors arranged in transform matrix Q, such that the estimated KLT eigenvector 
and corresponding KLT eigenvalue matrices of R n are Q n and A n , respectively. The 
10 estimation process is iterative such that the KLT basis vectors estimated for a current signal 
frame x n can be used to calculate the KLT transform coefficients of the next signal frame x n+I . 
Then, the KLT basis vectors are estimated for the next signal frame x n+} and used to 
f n calculate the KLT transform coefficients of the signal frame x n+3 > and so forth. 
%| The transmitter and the receiver of the present invention both estimate the KLT basis 

1| vectors, i.e., matrix Q n . The transmitter calculates the KLT transform coefficients^ based 
?*j on the previously estimated KLT basis vectors, matrix Q n _ x , and transmits these KLT 
f : transform coefficients to the receiver. The receiver then reconstructs the original signal 
« frame from these KLT transform coefficients y n by multiplying the KLT transform 

coefficients by the inverse of the estimated KLT basis vectors, matrix Q n _ r As such, the 
JflK KLT basis vectors at the transmitter and the receiver are the same. This feature allows the 
g2 present invention to transmit the KLT coefficients without the corresponding KLT basis 
vectors. 

Figures 2A-2C show a first embodiment of the method of KLT coding of the present 
invention in which the KLT coefficients are transmitted to the receiver in order to reconstruct 
25 the original signal frame. 

Figure 2 A shows the steps performed at the transmitter in the method of the first 
embodiment. In step S210, the KLT basis vector matrix Q , is initialized to the first r 
columns of an N by N identity matrix and the KLT eigenvalue matrix A is initialized to an r 
by r identity matrix. The integer r is a predetermined positive integer. Note that the KLT 
30 basis vectors are initialized to orthonormal vectors. 

In step S212, a search direction vector v n is selected. The search direction represents 
a direction in space to be searched in order to eventually reach the true KLT basis vectors of 
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the original signal frame. In this embodiment, the search direction vector v n is set to a 
white noise vector, for example. 

In step S214, the KLT basis vector matrix Q n is expanded accordingly to include the 
search direction vector v n to produce Q n . 

In step S216, the transform coefficients y n are calculated from the previously 
estimated basis vector matrix Q n ^ v prior to expansion, and the original signal frame x n 
according to Equation (2): 

v =6 T x (2) 

In step S218, the transform coefficients are updated to include a scalar component 
corresponding to the search direction vector v n to produce y n . 

In step S219, the updated transform coefficients y n are quantized to produce y n . 

In step S220, the updated transform coefficients y n are transmitted to the receiver. 
Note that he number of bits allocated to encode each KLT transform coefficient may be 
predetermined or calculated using, for example, the optimal scheme given by Equation (9). 
Moreover, additional optional information may be transmitted to the receiver along with the 
KLT transform coefficients and this information may include data regarding the bit allocation 
scheme. 

In step S222, the matrices F and G are calculated. F is an updated estimate of the 
autocorrelation matrix, where Q n _ x is the previously estimated KLT basis vector matrix and 
A w _ 2 is the corresponding KLT eigenvalue matrix. Equation (3a) is a calculation of F: 

f - vq t Q i ,Q T nQ + vy T (3a) 

in which 7 is a constant between 0 and 1 , Q n is the expanded KLT basis vectors matrix 
from step S214, andj w are the quantized KLT transform coefficients. G is an associated 
matrix calculated according to Equation (3b): 

G=Q^Q n • <31>> 



After F and G are calculated, they define the generalized eigenvalue problem shown in 
Equation (4): 

FW n = GW n U n (4) 



in which W„ and IL n are the respective updated eigenvectors and eigenvalues of the 
autocorrelation matrix. 

In step S224, using standard techniques, the generalized eigenvalues problem is 
solved for W n and II H . Details of standard techniques are described in Matrix Computations 
by Golub and Van Loan, 1989, the entire contents thereof incorporated herein by reference. 

In step S226, the KLT basis vector matrix and the corresponding eigenvalue matrix 
are updated using W H and IL n . Hence, the KLT basis vectors are estimated at the transmitter. 

Steps S212-S226 are repeated for all additional signal frames. 

Figure 2B shows the steps performed at the receiver in the method of the first 
embodiment. In step S250, the KLT basis vector matrix Q is initialized to the first r 
columns of an N by N identity matrix and the KLT eigenvalue matrix A is initialized to an 
r by r identity matrix. The integer r is the same predetermined positive integer used by the 
transmitter. 

In step S252, a search direction vector v n is selected. The search direction vector of 
the transmitter and the receiver are the same. 

In step S254, the basis vector matrix Q n is expanded accordingly to include the 
search direction vector v n to produce Q n . 

In step S256, the transform coefficients y n are received from the transmitter. Note 
that additional optional information may also be received at this step, including information 
regarding the bit allocation scheme used to encode the KLT transform coefficients. 

In step S258, the reconstructed signal x n is found according to Equation (5a): 

in which y n are transform coefficients and Q n „ x is the previously estimated KLT basis vector 
matrix, prior to expansion. 

Steps S262-S266 are similar to the steps S222-S226 performed by the transmitter to 



estimate the KLT basis vectors. As such, the receiver can estimate the KLT basis vectors and 
reach the same estimate as the transmitter. Thus the receiver can estimate the KLT basis 
vectors and use them to reconstruct the original signal successfully without having received 
the basis vectors from the transmitter. 

Steps S252-S266 are repeated for all additional signal frames. 

Figure 2C shows an exemplary algorithm for performing KLT coding in the first 
embodiment. 

Figure 3 is a graph showing an exemplary result of the first embodiment of the 
present invention. A signal x(n) is defined as 

( . f cos(0.35un)+cos(0.78TO+0.357i;), n-l,...,999 , , 

* W \ cos(0.6iw)+cos(0.8rai+0.35ii), w = 1000,...,2000 



The mean squared error, defined in Equation (5b), 

2 e°(n) = | \x n ~xj | 2 (5b) 

Si 



is an estimate of the difference between the original signal frame and the reconstructed signal 
frame, for different signal frame lengths N. Note that for this result, each signal frame x n is 
defined with the maximum possible overlap of N-l signal elements. The results in Figure 3 
show that the mean squared error is very low initially and continues to decrease as n 
increases. At n=1000, e°(n) increases because the signal pattern changes. However, the 
error is still low and decreasing. Thus, the reconstructed signal is very close to the original 
signal. 

Figures 4A-4C show a second embodiment of the method of KLT coding of the 
present invention. In this embodiment, an optimal search direction vector is found from a 

20 predetermined set of possible search directions. The optimal search direction vector is the 
one that maximizes the trace of the eigenvalue matrix U n . The trace of the eigenvalue 
matrix indicates the magnitude of the eigenvalues. The trace should be maximized as an 
indication that the total energy of the eigenvalues is relatively large. Large eigenvalues 
indicate a good selection for the Q matrix and a good decorrelation of the original signal 

25 frame in obtaining the KLT transform coefficients. Instead of setting the search direction 

vector to, for example, a white noise vector as in the previous embodiment, an identical list 



-9- 



or codebook of candidate search direction vectors is stored at both the transmitter and 
receiver. 

Figure 4A shows the steps performed at the transmitter in the method of the second 
embodiment. In step S410, the KLT basis vector matrix £>, is initialized to the first r 
columns of an AT by ^identity matrix and the KLT eigenvalue matrix A is initialized to an r 
by r identity matrix. The integer r is a predetermined positive integer. Note that the KLT 
basis vectors are initialized to orthonormal vectors. 

In step S412, a search direction vector v n is selected from the codebook. The order 
of the selection may be random, sequential, or based on some specific ordering. 

In step S414, the basis vector matrix Q n is expanded accordingly to include the 
search direction vector to produce Q n . 

In step S416, the transform coefficients y n are calculated from the previously 
estimated basis vector matrix Q n _ v prior to expansion, and the original signal x n according to 
Equation (2). 

In step S418, the transform coefficients are updated to include a scalar component 
corresponding to the search direction vector v n to produce y n . 

In step S420, the updated transform coefficients y n are quantized to produce y n . 
In step S422, eigenvector matrices F and G are calculated, as in Equations (3a) and 

(3b). 

In step S424, following Equation (4), using standard techniques, the generalized 
eigenvalues problem is solved for W n and II rt . 

In step S426, the KLT basis vector matrix and the corresponding eigenvalues are 
updated using W rt and IL n , 

In step S428, the trace of II n is calculated. 

In step S429, an inquiry is made whether the calculated trace is greater than a given 
value. If the trace is not greater than the given value, then step S43 1 is performed. However, 
if the trace is greater than the given value, then, in step S430, the calculated trace becomes 
the given value, the index of the search direction vector in the codebook is stored, the 
corresponding KLT coefficients are stored, and step S431 is performed. 

In step S43 1, an inquiry is made whether all search vectors in the codebook have been 
selected. If not, steps S412-S429 are performed. Otherwise, step S432 is performed. 

In step S432, both the quantized transform coefficients y n and the codebook index m 0 
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of the search direction vector corresponding to the maximum calculated trace are transmitted 
to the receiver. Note that he number of bits allocated to encode each KLT transform 
coefficient may be predetermined or calculated using, for example, the optimal scheme given 
by Equation (9). Moreover, additional optional information may be transmitted to the 
5 receiver along with the KLT transform coefficients and this information may include data 
regarding the bit allocation scheme. 

Steps S412-S432 are repeated for all additional signal frames. 
Figure 4B shows the steps performed at the receiver in the method of the second 
embodiment. In step S450, the KLT basis vector matrix Q, is initialized to the first r 
1 0 columns of an TV by N identity matrix and the KLT eigenvalue matrix A is initialized to an r 
by r identity matrix. The integer r is the same predetermined positive integer used by the 
transmitter. 

% In step S452, the quantized transform coefficients y n and the codebook index m Q are 

€! received from the transmitter. Note that additional optional information may also be received 
l#j at this step, including information regarding the bit allocation scheme used to encode the 
J% KLT transform coefficients. 

W In step S454, the reconstructed signal x n is found from Equation (5). 

IM, In step S456, the optimum search direction vector v n is retrieved from the codebook. 

J I Recall that the codebooks of the transmitter and the receiver are the same. 
2D! In step S458, the basis vector matrix Q is expanded accordingly to include the 

£T optimum search direction vector to produce Q n . 

Steps S462-S472 are similar to steps S422-S426 performed by the transmitter to 
estimate the KLT basis vectors. As such, the receiver can estimate the KLT basis vectors and 
reach the same estimate as the transmitter. Thus the receiver can estimate the KLT basis 
25 vectors and use them to reconstruct the original signal frame successfully without having 
received the KLT basis vectors from the transmitter. 

Steps S452-472 are repeated for all additional signal frames. 

Figure 4C shows an exemplary algorithm for performing KLT coding in the second 
embodiment. 

30 Figure 5 is a graph showing an exemplary result of the second embodiment of the 

present invention. Similar to Figure 3, the mean squared error e°(n) for different signal 
frame lengths AT is shown as a function of n for the signal defined in Equation (5a). In this 
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case, the mean squared error decreases rapidly because the optimum search direction vector 
results in faster convergence toward the true KLT basis vectors. Again, at n=1000, e°(w) 
increases because the signal pattern changes. However, the error is still low and decreasing. 
Thus, the reconstructed signal is very close to the original signal. 

Figures 6A-6C show a third embodiment of the method of KLT coding of the present 
invention. In this embodiment, the dimension of the signal subspace is not known a priori. 
In practice, the eigenstructure of most signals tends to vary considerably over time. In such 
cases reconstructing the signal is challenging. Therefore, it is desirable to have a mechanism 
for adjusting the signal subspace dimension to accommodate signal variations. One approach 
is to estimate all TV eigenvectors, in which case no search direction vector is used. An 
advantage of this approach is that the eigenvectors found are those of the sample 
autocorrelation matrix. 

Figure 6A shows the steps performed at the transmitter in the method of the third 
embodiment. In step S6 10, the KLT basis vector matrix Q and the KLT eigenvalue 
matrix A are initialized to the Nby N identity matrix. 

In step S612, the transform coefficients y n are calculated from the previously 
estimated basis vector matrix Q n _ p prior to expansion, and the original signal x n as in 
Equation (2). 

In step S614, the transform coefficients y n are quantized to produce y n . 
In step S616, the mean squared error p and the signal subspace dimension k are 
initialized. 

In step S618, the original signal frame is reconstructed using the initial signal 
subspace dimension k to produce x n . 

In step S620, the mean squared error is determined from the reconstructed signal 
frame and the original signal frame, according to Equation (6): 

M 22 22,1 ( 6 ) 

In step S622, the signal subspace dimension k is incremented by 1. The dimensions 
of the subspace are increased until enough basis vectors are present to meet the 
predetermined mean squared error threshold MSE max , i.e., the basis vectors adequately span 
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the signal space. If, however, the dimension N of the vector space is reached and the mean 
squared error threshold MSE max is still not met as inquired in step S624, then the following 
steps are performed. 

In step S626, the columns of the KLT basis vector matrix Q n are orthonormalized. 
In step S628, the dimension of the subspace k is reset to 1. 

In step S630, the KLT transform coefficients are determined for the reset subspace. 
In step S632, the KLT transform coefficients are quantized. 

If, in step S624, the iV-dimensional vector space is not exceeded or the mean squared 
error threshold is met, then step S634 is performed. If the mean squared error still does not 
meeting the threshold, steps S618-S634 are repeated at a higher subspace dimension. 

In step S634, if the mean squared error threshold has been met, however, then the 
optimum signal space dimension r opt (also indicating the number of KLT coefficients) is set 
in step S636 to k-L 

In step S640, the quantized transform coefficients y n and the optimum signal 
subspace dimension r opt are transmitted to the receiver. Note that he number of bits allocated 
to encode each KLT transform coefficient may be predetermined or calculated using, for 
example, the optimal scheme given by Equation (9). Moreover, additional optional 
information may be transmitted to the receiver along with the KLT transform coefficients and 
this information may include data regarding the bit allocation scheme. 

In step S642, matrix H is calculated. H is a unitary transformation of the 
autocorrelation matrix of y n , as shown in Figure (7): 

H =yK-i + y n yn < 7 > 

in which y is a constant between 0 and 1 and K n _ x is the estimated eigenvalue matrix. H 
then defines a generalized eigenvalue problem as shown in Equation (8): 

HQ =Q A . (8) 

In step S644, using standard techniques, the generalized eigenvalue problem is solved 
for Q n and A n . Thus the KLT basis vectors are estimated at the transmitter. 
Steps S612-S644 are repeated for all additional signal frames. 
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Figure 6B shows the steps performed at the receiver in the method of the third 
embodiment. In step S650, the KLT basis vector matrix Q and the KLT eigenvalue 
matrix A are initialized to the NbyN identity matrix. 

In step S652, the receiver receives the EXT transform coefficients and the signal 
subspace dimension (also indicating the number of KLT coefficients) from the transmitter. 
Note that additional optional information may also be received at this step, including 
information regarding the bit allocation scheme used to encode the KLT transform 
coefficients. 

In step S654, the KLT transform coefficients are used to reconstruct the original 
signal frame from Equation (5) based on the transform coefficients corresponding to r „ in 
which the transform coefficients for signal subspace dimensions greater than r t are set to 
zero. 

In step S656, matrix H is calculated according to Equation (7). 

In step S658, the KLT basis vector matrix and corresponding eigenvalues of the 
original signal frame are estimated using Equation (8). Thus the receiver can estimate the 
KLT basis vectors and use them to reconstruct the original signal frame without having 
received the basis vectors from the transmitter. 

Steps S652-S658 are repeated for all additional signal frames. 

Figure 6C shows an exemplary algorithm for performing KLT coding in the third 
embodiment. 

Figure 7 is a graph showing an exemplary result of KLT coding using the method of 
the third embodiment of the present invention. Figure 7 shows an original and reconstructed 
signal obtained using the quantized KLT transform coefficients without transmitting the basis 
vectors. The mean squared error is minimal as can be seen by the closeness of the two 
signals. 

Figures 8A-8C show a fourth embodiment of the method of KLT coding of the 
present invention. In this embodiment, rather than updating the reduced autocorrelation 
matrix F with the KLT coefficients, the sample autocorrelation matrix is updated with the 
reconstructed signal frame x n . Moreover, instead of updating R n on a frame-by-frame basis, 
we can update it on a sample by sample basis by concatenating*^ with x n . This enables a 
more accurate estimate of the sample autocorrelation matrix since more signal frames are 
used in its computation. 
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Figure 8 A shows the steps performed at the transmitter in the method of the fourth 
embodiment. In step S810, the KLT basis vector matrix Q is initialized to the NbyN 
identity matrix, x n is initialized to a zero vector of length TV, and the sample autocorrelation 
matrix R is initialized to the NbyN identity matrix multiplied by a small constant less than 
L 

In step S81 1, the transform coefficients y n are calculated from the previously 
estimated basis vector matrix Q n _ v prior to expansion, and the original signal x n as in 
Equation (2). 

In step S812, the number of bits allocated to encode each transform coefficient is 
calculated using Equation (9): 



Jb =B + 0 . Slog. 



IE 



opt 
+1 



A 



n-l 



(9) 



where b k is the number of bits allocated to the transform coefficient, B is a constant, and 

[A nA ] k is the K h eigenvalue. The bit allocation in Equation (9) is the standard rule for 

minimizing mean-squared error. 

In step S8 14, the transform coefficients y n are quantized to produce y 

In step S816, the mean squared error p, the signal subspace dimension k, and the bit 

allocation index b are initialized. 

In step S818, the original signal is reconstructed at the initial signal dimension k to 

produce x n . 

In step S820, the mean squared error is determined for the reconstructed signal and 
the original signal, as in Equation (10): 

I I V*J \ 2 do) 



In step S822, the signal subspace dimension k is incremented by 1. The dimensions 
of the subspace are increased until enough basis vectors are present to meet the mean squared 
error threshold, i.e., the KLT basis vectors adequately span the signal space. If, however, the 
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dimension N of the vector space is reached and the mean squared error threshold is still not 
met as inquired in step S824, then the following steps are performed. 

In step S826, a predetermined bit allocation is used. 

In step S828, the bit allocation index b is incremented. 

In step S830, the dimension of the subspace k is reset to 1. 

In step S832, the transform coefficients are determined for the reset subspace. 

In step S834, the KLT transform coefficients are quantized. 

In step S824, if the N dimensional vector space is not exceeded or the mean squared 
error threshold is met, then the process goes to step S836. If the mean squared error still does 
not meet the threshold and bits have successfully been allocated for coding the transform 
coefficients, e.g. b<2, steps S818-S836 are repeated at a higher subspace dimension. 

In step S836, if either the mean squared error threshold has been met or the bit 
allocation has not been successful, however, then step S838 is performed. If, in step S838, 
the bit allocation index does not equal 2, the optimum signal space dimension r opt (also 
called the number of KLT coefficients) is set in step S839 to k-L 

In step S840, if the bit allocation index equals 2, the optimum signal space dimension 
r opt is set to N, the dimension of the vector space, and then, in step S842, reduced until 
y (r ,) # 0. 

s « v opt* 

In step S844, the quantized transform coefficients y n , the optimum signal subspace 
dimension r op0 and the bit allocation index b are transmitted to the receiver. 

In step S846, the signal sample vector w is updated to include x n _ x and x tt . 

In step S854, the autocorrelation matrix R n _ hm is updated for the wth signal sample 
(m = 1,...,N) from w in Equation (11): 

4-i ia = YWi + wT (ID 

R n9 the autocorrelation matrix after all TV vectors of w are used, is then put into the 
generalized eigenvalue problem as shown in Equation (12): 

£ Q =Q A . (12) 
In steps S858, using standard techniques, the generalized eigenvalues problem is 
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solved for Q and A . Thus the EXT basis vectors are estimated at the transmitter. 

Steps S81 1-S858 are repeated for all additional signal frames. 

Figure 8B shows the steps performed at the receiver in the method of the fourth 
embodiment. In step S864, the KLT basis vector matrix Q is initialized to the TV by TV 
identity matrix, x n is initialized to a zero vector of length N, and the sample autocorrelation 
matrix R is initialized to the Nby N identity matrix multiplied by a small constant less than 
1. 

In step S866, the number of bits allocated are calculated using Equation (9). 

In step S868, the KLT transform coefficients, the signal subspace dimension (also 
indicating the number of KLT coefficients), and the bit allocation index are transmitted to the 
receiver from the transmitter. If the bit allocation index does not indicate that the bit 
allocation was calculated using Equation (9), e.g. b=0, then the predetermined bit allocation 
is used in step S870. 

In step S872, the signal is reconstructed using the quantized transform coefficients as 
in Equation (5). 

Steps similar to the transmitter steps S846-S858 are performed at the receiver in steps 
S874-S886 to estimate the KLT basis vectors after each signal frame is reconstructed. As 
such, the receiver can estimate the KLT basis vectors and reach the same estimate as the 
transmitter. Hence, the receiver can estimate the KLT basis vectors and use them to 
reconstruct the original signal successfully without having received the basis vectors from the 
transmitter. 

Steps S864-S886 are repeated for all additional signal frames. 
Figure 8C shows an exemplary algorithm for performing KLT coding in the fourth 
embodiment. 

Figure 9 is a spectrogram of an original speech signal and the reconstructed signal at 
two different bit allocations, as derived according to the fourth embodiment. The 
spectrogram shows the signal frequency over a time period. At both allocations, the 
reconstructed signals are very close to the original signal. In addition, minimal degradation 
of the signal is experienced. 

Figures 1 OA- IOC show a preferred fifth embodiment of the method of KLT coding of 
the present invention. In this embodiment, the transmitter computes the KLT basis vectors 
based on the actual, unquantized signal frame x„. Additionally, in this embodiment, the KLT 
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coefficients are computed using the KLT basis vectors derived from all of the signal frames 
up to and including the current signal frame x n . In the first four embodiments, the KLT 
coefficients are computed using the KLT basis vectors derived from the signal frames up to, 
but not including, the current frame (eigenvectors of i?^). 

Figure 10A shows the steps performed at the transmitter in the method of the fifth 
embodiment. In step SI 010, the KLT basis vector matrix Q is initialized to the NbyN 
identity matrix and the autocorrelation matrix R is initialized to the TV by JV identity matrix 
times a small constant less than L 

In step S 1012, the autocorrelation matrix R n is calculated using the previous value 
and the current signal frame x n . 

In step S1014, using standard techniques, a generalized eigenvalue problem is solved 
for Q n and A w . 

In step S 1016, the KLT transform coefficients^ are calculated from signal frame x n 
and the KLT basis vector matrix. 

In step S1018, the mean squared error p and the signal subspace dimension k are 
initialized. 

In step SI 020, the original signal frame is reconstructed using the initial signal 
subspace dimension k to produce x n . 

In step SI 022, the mean squared error is determined from x n and x n according to 
Equation (6). 

In step SI 024, the signal subspace dimension is incremented by 1. 

In step SI 026, if the mean squared error p exceeds a predetermined value MSE max , 
steps S1020-S1026 are repeated. Otherwise, step SI 028 is performed. 

In step SI 028, the optimum signal subspace dimension r t is set to k-L 

In step SI 030, the KLT transform coefficients^ are quantized to give y . 

In step S1032, the quantized KLT transform coefficients j/„ and the optimum signal 
subspace dimension r opt are transmitted to the receiver. Note that he number of bits allocated 
to encode each KLT transform coefficient may be predetermined or calculated using, for 
example, the optimal scheme given by Equation (9). Moreover, additional optional 
information may be transmitted to the receiver along with the KLT transform coefficients and 
this information may include data regarding the bit allocation scheme. 

Steps S1012-S1032 are repeated for all additional signal frames. 
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Figure 10B shows the steps performed at the receiver in the method of the fifth 
embodiment. In step S1050, the KLT basis vector matrix Q is initialized to the NbyN 
identity matrix and the autocorrelation matrix R is initialized to the TV by ^identity matrix 
times a small constant less than 1 . 

In step SI 052, the KLT transform coefficients and the signal subspace dimension 
(also indicating the number of KLT coefficients) are received from the transmitter. Note that 
additional optional information may also be received at this step, including information 
regarding the bit allocation scheme used to encode the KLT transform coefficients. 

In step SI 054, a counter m is initialized. 

In step SI 056, a value € measuring a matrix norm is initialized to be greater than a 
predetermined matrix norm value e max . 

In step SI 058, the original signal frame is reconstructed using the initial signal 
subspace dimension k to produce x . 

In step SI 060, the autocorrelation matrix R n is calculated based on the value of the 
counter m, a predetermined parameter M, and x . 

In step SI 062, using standard techniques, a generalized eigenvalue problem is solved 
for Q n and A B . Depending on which eigenvalue solver is used, the sign of the eigenvectors 
in Q n must be checked for consistency with those previously stored or initialized Q v 

In step SI 064, the change e in the KLT basis vector matrix is computed using a 
standard matrix norm according to Equation (13): 

In step SI 066, the current value of the KLT basis vector matrix Q n is stored. 

In step SI 068, an inquiry is made whether the change e in the KLT basis vector 
matrix is greater than the predetermined value e max . If so, steps S1058-S1068 are repeated. 
If not, step SI 070 and subsequent steps are performed. 

In step SI 070, the counter m is incremented. 

In step SI 072, an inquiry is made whether the counter m exceeds the predetermined 
value M. If not, steps S1056-S1068 are repeated. Otherwise, no further steps are performed. 

Thus the receiver can estimate the KLT basis vectors and reached the same estimate 
as the transmitter. Hence, the receiver can estimate the KLT basis vectors and use them to 
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reconstruct the original signal successfully without having received the basis vectors from the 
transmitter. 

Figure IOC shows an exemplary algorithm for performing KLT coding in the fifth 
embodiment. 

Figure 1 1 shows an exemplary KLT coding system of the present invention. At the 
transmitter 10, an original signal frame x n is transformed by a KLT transformer 1 100 into 
KLT transform coefficients y n . The KLT transform coefficients are quantized at the 
quantizer 1 1 10 to yield the signal y n . As a result of quantization and possibly discarding 
transform coefficients that are zero, the quantized signal y n that enters the encoder 1 120 is 
significantly reduced from the original signal x„. The encoded signal is then sent along the 
channel. Depending on the specific embodiment, additional information may be sent as well. 
For example, the codebook index used in the second embodiment, the bit allocation index 
used in the fourth embodiment, etc. 

At the receiver 1 1 , the encoded signal is received through the channel into the 
decoder 1 130. The signal is decoded, yielding the quantized transform coefficients y n . The 
original signal frame is reconstructed at the KLT inverse transformer 1 140 to produce the 
reconstructed signal frame x n . 

The mechanisms and processes set forth in the present description may be 
implemented using a conventional general purpose microprocessor programmed according to 
the teachings in the present specification, as will be appreciated to those skilled in the 
relevant art(s). Appropriate software coding can readily be prepared by skilled programmers 
based on the teachings of the present disclosure, as will also be apparent to those skilled in 
the relevant art(s). 

The present invention thus also includes a computer-based product which may be 
hosted on a computer readable storage medium and include instructions which can be used to 
program a computer to perform a process in accordance with the present invention. The 
storage medium can include but is not limited to, any type of disk including floppy disk, 
optical disk, CD ROMS, magneto-optical disks, ROMS, RAMS, EPROMS, EEPROMS, 
flash memory, magnetic or optical cards, or any type of media suitable for storing electronic 
instructions. The instructions can be further read from other computer readable media such 
as transmission media of computer communication devices (e.g., Ethernet and wireless (e.g., 
IR or RF) adapters). Listings for sample implementations in MATLAB© of the first, second, 
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and fourth embodiments are listed in the Appendix. 

Numerous modifications and variations of the present invention are possible in light 
of the above teachings. For example, the structure of the algorithms used to implement the 
invention may take on any desired form. Further, in each embodiment, the number of KLT 
coefficients transmitted or received and the corresponding number of estimated KLT basis 
vectors can be as few as one. It is therefore to be understood that within the scope of the 
invention, the invention may be practiced otherwise than as specifically described herein. 
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